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(54) DEVICE AND METHOD FOR ANALYZING JAPANESE MORPHEME 

(57)Abstract: 

PURPOSE: To output only an optional number of pairs of 
word-divided and part-of-speech added candidates from 
the most likelihood candidate even when an input 
sentence includes an unknown word by degenerating a 
double Markokv process into a single Markov process in 
consideration of secondary expansion of a symbol, and 
handling part-of-speech triple probability in a frame 
obtained by expanding a conventional connection cost 
minimizing method. 

CONSTITUTION: This device is provided with a part-of^ 
speech model estimating means 110, a part-of^speech 
triple possibility table 1 20, a part-of^speech distinctive 
word output probability table 130, an minimum path 
score table 1 70, and a forward search means 1 40 and a 
backward search means 1 50. On the basis of a part-of- 
speech added model constituting of part-of-speech 
triple probability and part-of-speech distinctive word 
output probability, the forward search means 140 is used 
first to store the optimum path score table 1 70 with the 
maximum value of simultaneous probability of a word string and a part-of-speech string from 
the head of the sentence to one word, and on the basis of the value of the optimum path score 
table 170, the backward search means 150 is used to finds an optional number of morpheme 
analytic candidates in the most likelihood order. 
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(ttS:. K*!f fc^tf itfifl© 2 ofO^fHwft-^ * nfc&gg 



4#^¥7-2 7 1 7 9 2 
1>bLV\ 7^^^<D¥^K^ 0 . aB^&t/ag^B<J^8Stti 

«ftj^»cs-iv>-c. :S:^:-r-3iitfK)e*)8f 

20 B;4s:^^ag^ftP«f:»i&. 

25 ^fiitb. 

[0 0 0 ll 

8gic»«u 'fr^isi-aa^t^'^i-sB^igj^flg^giifW 

40 Ufc<>«>'C*)S. 
[0 0 0 31 

— y^'^ (heuristics)) S:fflV^T^tiBO»K{fiC{+ 

[00041 )^fe}RA?ff-effiV^&nS%M.6<)%Rd2: bT 
50 K?»«f^ffiSrffiife-t-5Sfi-ate 1 jts<o;fyttc) 
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fc»#B*»§:SC<0^ffiSiftP«fj mftllft Vol.24 No. l.pp. 
40-46. 1983) *S*> 5 2 «Otae3t5<0:^ife) . 
[0 0 0 51 ScfifiSfcfi^/J^ffiSrJtSSL, «?Sri¥ilB(r 

j?g^{'f»fr5:^j*t UT. JSiK=x hfli/hjfe (^k3t-tf 

B rtg^a;:^ hS/Mr J: 5JgfliSl»«f«)l!llgi: 
If^a5{-o^^TJ ft^^ NLC90-8. pp. 17-24. 1990) ASfo 

3fe(o:^ai) , 

[0 0 0 61 s^c. ifi^. ±i2(otse3i5ro:^ifet?*>5 rja 

[0 0 0 71 ±K©|K3«03li6eiJwei^=»;»^ 
i9!- WW rjS^5:aiXifel=iSW3t««fJ W«i NL56-3. 

1986) . :i<o*jfe.-ctt. jft^iEasrffi, B|i*>. &m<r>m 

( O 0 0 8 J iiawiKSfM/iSIS^T'A'SrfflV^Si 4: t 

[0 0 0 91 t«Jt€roB;4c8f}Klij{S««f5^^7^^tw 
rsayt")ft<) (ad hoc) J -C*>5. #<<0->';^'7'A|±, 
V^J , aVMl, r;&^'*-^fl?iS«!l*^1-3lE»<Oi&B^T?*>« 

f»'Bfl tmr^fift Vol.30 Ho. 3i pp. 294-301. 1989). licV^ 

rt^s^v^ (m 5 of«3fe<o:^ffi) . 
[0010] jtcjaiSI»18glc^-rd«e8tM'!cA¥d^»^ U 

5¥3§<OjglS*ryWi:-tWSfffliJ Vol.34 No. 9. 

pp. 1944-1965. 1993). Z.<0^mn. ^SgS^SO^ffiUSg 

[0 0 1 1 1 

[3BW*M?»UJ:5 tt-58Wai L.A»U<e*se>. ±15!* 

[ o o 1 2 ] ±.ta<om I wttjfewj&^teoi&s— stffeic 



05 (2) ms§^itaxm<ofi:^t^^^mmtfjmmi^x\>^ 

(0 0 131 Se>lC, ±aBO«2 0(j6*03^j&-C*)5X 
10 (1) A/)S:^?iJSrfi9fig-r5S:f3l<oea;J5SW^lc/i5)i? 
(2) -ffiii. ^:fiisl9c®/l^^:^^^■5^g^i^±«»#^QE-f 6<o 

15 [00 141 ±.tim3(OV^ikn:^m-e»,imm. 
20 (0 0 1 51 mft^mm^iMtm^JEmxmizm^ 

[0016] (1 ) -fl3:(C. iB.g^<OigfiSffS^ 
*S«0|6j±Sri*^LTV^5. U«»U. SiKa:* h«/Mfe 

30 (00 1 71 ( 2 ) ^3 ^ hft'htfeit. m±igtmt: 1^ 

(0 0 181 ±ffi05|5i9>8S08kV^W*^Jfe«c*Jlt5 
40 9, JitfiW«#©*jifett, *>5XIIRC*i»t5X!?Jl|<0*. 

(0 0 191 ±IBfB6cot«3l5©:*rfttt, *J8IKW¥IS%> 

(00 201 ( 1 ) g?^-e^fe$tv5ia^s»j:»i-«j& 
50 [00 2 1] ( 2 ) ^jienb^oitDS^i 9 . &m 
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[0022] (3) »»0^fflbffi*>e>^7'-'^'^7>- 
10023) (4) A:*JiJ©#l§e>t*4rffflIii-Sfc*«t 

10 0 2 4] *:5SWI4» ±8B<0;Sl(i«*J!t*4xfc t» 
[0025] 

(002 61 *38WO)Jgfil3g)5?«f $IBH, B *:SS<0«OA 

HfcX<o*^*>^. ai^H-ojajft^i: p"aigBiJ*8§ttJ:^S6 
^Sr«l!£-t-5Sg^<+lt^f'/i'«l;fe^iS;l 1 ot, s,mE. 
oia«l«P*:Eiaii-5ft8SIHoffi«i^y— 1 2 O t . 

y/P 1 3 0 t 3tW*'^e>*>*^K«::M5*-Cro^8§?«t 
Sgq?i|(Oraii»fll^©ft*«[«rlEtfi:i- 5 SffiSSS =• T 
— 1 7 0 t . SSSIS^ 3 tt'— T'/i' 17 0 IclEtg 
S *VT V > 5 e> fc 5 ¥8Sl::M 5 * t?co ^g§5'J t a i»1 
?iJ(OPB$5fcsp9iS;*:ffiSr. *8gSr^tfii:fla«2oro*8§ 

»5>. ft3afitt;^=7"^— :^/n 7 o«j:ia»-r5Ssri6it8g 
ss^si 4 0 ^:,■^l55lJtfpi^?l|(OlslBt^^^!^^^®:^c{k1- 
5J:5'^cA;'3S:ro^lf^J^&u'la8g^'^■^^ffiS:. xm^ 

Jt^f'/UcS-tJv^-C. SI", BiJf«i)#fl!3S^©:l 4 0«:ffl 



a®Stt;^3r7'-yA'i 7 0«>ffl[«::s<5i^r«i6jg:» 

j^^ai 5 0firfflv^T^t*te>UV^)e»«wffiJS05fiift 
05 10 0 2 7] Sfc. *:»W<OB*l§ftf«fi$ai±. 

SC!f:=otaot6^4-«l^i-5*fS^7'-'H6^#&2 0 0 
sp4r^^5*H*5^-'H 9 O iaM9JS:!*:=offlS|ll^ 

10 Srtetfii-aaM8'J:S:#:Hoa5Si^7^-://P2 1 0 *> 

;/j«6^<oiaSr*«)5*iS<RBL^^eiJi SOt, A;^S:'*> 

fifctv ftf6l*«S«^ai 5 0^cj3^^T, :S:^«:4r!%lSEL 

D°a8^S'J*g§m;'3l«^«:*«> 5. 
20 lO 0 2 81 mail. ;*^36?qcolg3igSrlfteqi-Sfc«)<07 
a— ^-r— hi?*)*. 

[0 0 2 91 ;t:S?l1»B*g§JKliS5flS?Sf*&(4, iSLS^H 
-5 *8S5!I t *S§l-#4- * *tfcfi8g?iJO|5lfl#«l4sSr® 
•f - 5 IS) # t b iCiiS -r 5 ^ 1 8^3^ ^ 

30 :*:{tSr5lt«). 8a«*-r5. 

[0 0 3 01 ifc. ±SE<?5g^|6j#Si!mi4A* r/i'=f y X 

[00 3 11 A/33C*s»$JJ:«t»* 

<B.8i98ii¥tsm:^$(ii¥«^e>/j^5¥8giKKi^, g^mm-x^-=. 

40 o|aJ^l^»cS•^v^-t:A;^S:^#:5lJ;!)»b4:;«L, 
[0 0 3 21 

45 -v^un 7;©fiSr— r t »c J: 

fpgg?iJOl5lB#H6«^. E|l*>. fpg^HoJlSft^tu^lBlMiJ*^ 
50 W^«6iProSS«ra:^c{b-#-5J:5/'iJKflijR<M!«f«*iB (V8S 
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I0 0 3 3J nkiz. tiii^^mmx'imLt:Mcmm^^=' 

r^jpitas^j iri^tfixs. 

Suisse, Ept,, -e«:>¥KA^&:ft:«ic£.6«-c0o&jias 

TV^5. f>4xfcaK:, C«)««rSiO 

^t>'&[zX'0. (1) Si^<0^oiaw«l*SrfflV>T. 

[003 5] ^iaHi:m-&-ri>mmi-i.. ( i ) ^3§^# 

[00 3 61 *S4r«^fti-«S:*5ili:SMA«#^e>Hfc 
10 0 3 7] 3|s:5l§q-Cli, p°pS^9J5:^=offlS|^*>P,IS 



(0 0 3 81 ffioT. mmu^^Bt^fA^ 
05 «cS-5<3i:^^I2A»t><O^S<Slft^fiK». RO!. ±IEStr 

wi»}icwm-vi. (2) APHi^;)s^ii-c, o) j^ft 

[00 391 

IS [ 0 o 4 0 1 la 3 ft, ^9&fRo>—mmm<oms6:f oy^ 

[004 11 D PfiSsSSB 1 14, A;^)A<oS:p*»t> 
Sr^'^-SC^-f oiitflbfilJltHife (DP:Dynamic Program 

/i, A:^S:<o¥»5^|Mt&im't^<offl-Sr*ft5, cft8^2 

35 iSSttS, 

[00421 mHm.«t^^U 9 14, (OibMSf ii>& 

lc:*^v^T. A*:i:<ofcai:^BlJ:i3it5«&«»W4: 

40 Tfc*»tife)*1-5. 

[ 0 O 4 3 1 ^16] # A* «|$g|t 2 14, ffilfil $ D P «B 

[00441 a8^#lt^7'/V'«l;6S»4 J4, fiH^' if¥tt 

50 aK»i¥sw*«k!^*r«i^b, &m~.nmmf—-fi^ 
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5 &t/iB.g3SiJ*l§ttl;^56^7'-y/P 6 --feJfti-S. 

loo 4 Si *i§*-r-'i'«i;£i$E 7 1*. &mfi^n^=' 

HottsS ^y-y^ 8 '-46 Wi- «. 
[0 04 6] «T-C»i. ^/i'^ 

[00471 ( 1 ) aP#»t^7*/W©lft3£ 

10 0 4 81 *«W-Ctt, a J|cg§<OJi^«i3{l«fW0?fc«) 

P (W. T) = pC P ( t , I t , 
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ir, SPHol^^x/i' ( h^-f !l^^*7'/i' (ui-POS ) 
[0 0 4 91 A:fjS:*s^l§J^?'Jw=w,. w,. 
05 ■■• t. AM'^•^^i^fci:•^-5. h^-f^:^ (WTtri-POS) 
mn^P (W. T) fngiHoa«^P (t, I t 

,^t,.,) ta8^»J*eai;^p (w, i t.) »8Sf 

ao»t5IW)liJJ:»«**vS. 
[00 5 01 

mi] 

». t 1-1 ) P (Wi I t I ) 

(1) 



[005 11 HfflWttt. X«)^ISLj»»ail<c«»«r»o t?*)6. 
•ri^5<o-c, <Df^h>9»c^(2)«rfflv^5(oa5^ra 20 [005 2I 

P (W. T) -P (ti I P (wx I ti ) P (t, I #. ti ) 
P (w, I t, ) 



J5P(ti I ti-,,ti-i ) P (w. I t. ) P (# I t.-i. t. ) 

(2) 

[ 0 0 5 3 1 a8SJHo*ajfe^P( t , I t , t,^)t ,-, . t,) l±. fp83^'^^?iJt,.s. t,., . t^i^m 

fiS»J*I§ta*»J|sp(w, I t, ft*(3) (CJ:*) 30 HfcBft-CfcS. 

ag^^'^^##=i-^^;^fj:i3lt5ffi*HS«)4»t>«l:£-e# [00 5 4l 

i>. mu f (lti^@££«:!fi:>!>SBIIi£« N (w. t) It [SfC3l 
fi8il^'^^tSrfifo^Hlw*smnfc@». N (t,.,. t 

P ( t I It I-,, t 1-1 ) = f ( t , I t ,-, . t ,-x ) 

_ N (t . Xt-t , t ■ ) 

N (t,., . t.-x ) (3) 



P (w, I t . ) = f (w, It,) 



N (w. t) 

N ( t ) (4) 



[0 0 5 51 -tet, i(B*tmSt*^h. o'J.S^Hota J:5I-. -o». -offl. Hoffl(0*a»Mlt«rl*3lf-r5 

fflg1-5«>»4»bV^ JEri-C. fiPIHotta^©SF«fl: 45 (00 5 61 
ofcftic, rtlf«l3&ife«ri8v>S. w*v»±, *(5) fcip-r 

+ q , f ( t , I t ,., ) + q , £ ( t , ) + q , V (5) 
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[0 0 5 7] 12411. S8^^>/##3— 0a«:7P 

V^TI4. 
"3001-100 

to 0 5 8 J lasii. APHofasfe^ro— 0ij-e*>5. & 

P (u, I U,.,) =P I 

(006 3] 

P (W, T) = P (u, I u. 



[0 0 6 4] it(7) (4, iffi^W— lfc-ryl'3 7ii&i:|aiC 
P (W, . T.) =P (W,., . T,.,) 

fimmv^nd^p (w, , Ti) <om^B.^Mif>i>izit^ 

itip (w,.,. T,.,) roj&>c(e«rflElSU. (2) 
g|S»,*gg^JiJw, JCoV^-C|BjH#?ft^P (W, . T,) S: 

gmt. «-at^4;fni3^5flu,(=*ti-5raii*«ii?ip 

5. 

(0 0 6 51 iSo-c. 1 1 1 *»en*-eioi"ott^i* 
mf^m^P (w.. T.) 4rjir:*:{ki-5JS 

^>«< * * iifi 9 Iwttjfc* 5 i fc 3J« T? # /jCV ^ w 
f|W^fi6tt4:%fiS:U/i7Jse>, P]B*tiS#5P (W.. T.) 

(0 0 6 6] ^(r, |Sin$sii!^p (vv„. t.) i:m±it 
:fc:{ti-ailiS^«(lgSy'IU = u, . u, • u. t^tt^yiJ 



(00591 la 6 li, &mmmm^m^n-mx»i 

S. fpra9J*»ffl;^ttsp«)^-^tt, ftH> «IB, «IJP 

05 (006 01 ( 2 ) 7©iiiS<0«iii 

tiT-Cli, Slli6ltDP8B^t«iajt A•»«S^«^^•C^»- 
Best«^g(|gSi««f«*!r«^*^^)5T/^=^yXA3JS. AO) 

10 ixSwttr^-f. 

(0 0 6 1 1 u, = t ,JttJ«u, = t M t,t-f5i 

a-f-at, lk<DBa^AS^9Sio. 
(00 6 2] 
;t, I t,.,. t,.,) (6) 

-1 ) P (w, It.) 

(8) 

7ti-i,:Ltifix^^o W»*ffi*?i|«rw, =w,. 

w, . • w. , ui^&tmmi:T^ = t , - 1 , fcs 

Hi-it, ikcoJ:p/fB§«A5^5. 
P (u, I u,.,) P (w, I t,) 

(8) 

w=w, ■•■w„*s^»p>4^^). ro^s^t^fiimylJ^c*3v^ 

^B8«iLTfflv^4:ii:i::J:9, *t>*t> bbV^MfiJi- 
35 (0 0 6 71 (3) m6fjnmmi:m\^t:im\pi^mm 
iniiij#DP«ESKgBiijsftffi&!e;^=r7'-y/n o«c» 

40 (0 0 6 8] ia7K;^-f-J:5<C;^Oy h (7-f — 

yWK) t«fO, -parse " t "word" i:V*5 2O0«Jt 
ffc (U = -K) Sr^SrS, fi?ig(*eparse Jl, Sii^ig 

»*«J-*-5<OlCfflV^bix5. h "parse, sta 

rt" fcy^— ;^3i>'K "parse, end" »1, A;'3^:l-43»t5 

■ "parse, pos " (1, ^ffrop'tSaJ-e. ^^-014, *K<OS 
50 8^. ISfflSi, efflJ^wy hS:fllV^-CV»5, "Parse, nt 
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h-order-state " l±, ;iO*fSSr^tPfi«<^2 0(D*K 
iaS<Ot£^tt«li::»rt:>i-*. "Parse, prob-so-far " 

|^fflV^C>tv6o "Word, form, word, pos, word, prob ** 

10 0 6 91 »aSBS:^=«T7^->^/K WT-ett/^-:^^ 

ig6<Oii^ffi. EPt. "parse, start, parse, end , pars 
e. nth-order-state " 0ffi<0 y X hS::^— tt. 
-Srt*o>'^—:x (parse) ffl3&<0«1'-e, SiB»5)^SK:^ = 

10 0 7 0] iZ/l'OtftfPBBfti: LT. U 

>^(resister-parse) t^l/ h/^—>^ (get-par 
ses)Sr5Eli'?'6o 0IScUv^:^^>'"^"^ (resister-parse) 

—-/Mzm-To BiSc-ytX h^^--^ (get-parses) A/j 

yyKD^O±T<^S«( fi«<^- 
0(?>ia8g (parse, nth-order-state) C/^— :^fff3S<^ 
"I'-e. Sfi^ajaWi^OSK*^;^ => T (parse, prob-so-f 
ar) S:^o/^-;^«|jgo;9^«rft«>fc<0«rig-r„ 

to 0 7 21 WfS]#DP8imji. A;^S:(OifeS3^*e>i6* 

[0 0 7 31 ;^7^!y7'i) Ayji:oS:4={4St«r^-f-as» 
I SrOJcKS-rSo 
[0 0 7 4l i =0 

-C. BIgclengtMi. S:i^^yoS*«:ig-rB8Bc"CfcSo t 
jtJlSicjfiLTV^ixtf. fltrr&]e^DPa5«'«:«^Ti-5o 

(00 7 51 i < lenth (string) 

X7^5/:/3) BB»get-parse «rfflVNT*fg<Oj»T 



tC. -tOifeSli?igAS^»parse IC. « 0 Oil^;55agcpa 
rses|C»WSn6« w^-C. BaSfirst \%\) V <r>9tm 
SS^riSU. fflSrestfty ;^h3^»e>jfeBig*S:m^fcy 

05 parses : =get-parses (i, parse-table) ; 
parse :=first (parses) ; 
parses *=rest (parses) I 

[0 0 7 61 parse==nil ? 
15 ^T'^yTT'S) M^get-leftmost-substrings SrfflV^TS: 

i ;^*bi6*56»»3?iJt-a*t-^S*$^co^|goy 
>^ h;ft5*«>e>ix. «»words (::ftA*^^S. m^^<o9t 

mmmtm9i^r6\Z.^ ««?<DS*7&SS»Cwords dftA* 

20 words :=get-leftmost-substrings (string, i) : 
word :=first (words) : 

wux'dai ' =l*eait (wOi ds) * 

25 W'<fc<^"C*>ntf. ;^7"!y>^l 1 l:iS3V^Tparses(03feBa 
Sparse «::«AL. parsesOifeggHigSrSt 0 Sfe< . 
^P-Cftlttttf. 7^7"5/:^7mcD*Q.a«rff 5o 

[0 0 7 71 word=nil ? 
T^Tv'fl) ^Sparse, nth-order-state (^{(ItaLifcwo 
30 rdOpos V<r>^t^h. Sol^<r>^^^^^'t ^) ^ h 

Srjt^Kb. ^ftpos-ngrani (CftA-f^o wwT\ B8iSli 
st{«|«cS:IS*fc-rsy hSriSL. B8lfeappendlig|«!t 

oy>^ Kj:^*nssigS:iiieLfcy h*ig-rt<?5i: 

35 [00 7 81 pos-ngram:=append(pase. nth-order-stat 
e, list (word, pos) ! 

;^X$/:^8) S^aSpos-ngram IC^-tAStXfcp^pS^HofflCD 

1 0»::*JV^T> JJcoSiR^r^&wordMtA-r 
40 t>U. fpWZo|att^;5S0t?/jr*tixtf. JWTOfti3S 
tn^o Cl^l-e. raSctransprob («|»(Oia85 = OfflO 

[007 91 transprob(pos--ngram)=0 
:^7=-s/:/9) »fLV^-'^-;^WitS:o< O^Scne^v- 

45 parse IC{H5;Ai"6o B8^make-parseJlST LV^^<— ;^|Sxt 
^iSrt^Oti-^o r COiTrUV sparse «?jg(OM*&ffia(n 
ew-parse. start) It « i ^ tS^TtStSt (new-parse, end) 
(i. i tSE»wordJC»^$*X^^5§0^tecO:^$(0?P, 
d°p8^ (new-parse, pos) (i, gEScwordlC-fefi*! $ixfci^l§CO 

50 iSi^fiJ'CfoSo |ga*tfclll(new-parse. nth-order-sta 
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K> . ^iSS8S^=»T (new-parse, prob-so- far) li, iEfliJ 
O^lgOigjgSK^ 3 T (parse, prob-so-far) t SS^H 
OjfiBI^(transprob(pos-ngraro)) t ^Siai-;^fll^(word. 
prob) (Dia-Cfc6. r.a>3BfUl Sparse tSiSSr. Hi 

SCregister-parseSrffl^^T^'^^^'r — ^ (parse-tabe 
I) icSiaU ^xy^l Ofc^tT-tS, 

new-parse : ^make-parse () *■ 

new-parse, start :=i; 

new-parse, end length (word, form) ; 

new-parse. pos>=word. pes; 

new-parse, nth-order-state: =rest (pos-ngrain) ; 

new-parse, prob-so-far :=par sc. prob-so-far* transpro 

b (pos-ngram) * wrod. prob ; 

register-parse (new-parse, parse- table) ; 

^^y'yZ/lO) y^h words O jfeWS* Sr wordM t A 

words (DfM;^ (O^^^vords ^itT^^^c 
word : =f i r s t (words) ; 
words =rest (words) ; 

1) y ^ hparsestOifeggil^ Sparse ^ftA 

parsesOaO <03?SSrparses-^f^A"t*So 
parse :=first (words) : 
parses :=rest (parses) ; 

f (n) =g (n) + 
(omm (^'?-;^fflit)lcM-5^-COfD|filHo*ajft4ii:& 

[0 0 8 4] C(^>aiRl#A*ai«<Ofci«>JwH6K:^i-i 
9/cC:^n-/K 7^-yUK) «:«po/^;^ (path) tv> ^fi? 
jgflcl-^^-r-S. «lig(4^patMiA*fll^lc:*5$tS^^A 

Oy— KlCftSb. «lSE<?0^li(parse«ig) . 
<?5aiaS&a=»X hJ^B8i-2>t§»«r(SRFi-So Path.parse 
Ji, parse fflliaS:t&flrt't"5o Path, previous liSCSft^^pa 
tht«it'-^(OJK>l'>'3^-C*>So Path. cost-so-far«. 
<^tfigj5>e><D3;^ h-C*)So Path, total-cost II. tOJBtR 

[0 0 8 51 A*fli^-X?Ji. "open- i: "close - 
5— o<^>y hSrfflV^So P h "open" 

:rcJgM$ixT( ig-<e>ixT) v^//v^y-K(path «?it) 

iiL(c:S<5 < IE jfeiS^Md =^ =1 — (priori ty queue) Ictt o o 

Tv>2>. y h "close - mzimm^tiiti m-<h 
iQ OS 6] A^mm-cn. etst^figjcw/crs/^K 

5o K^w^**i^TV^S;fl^ *]ftr. Jg 



2) a!»i<ofii[S:'<>'i5^y>>'h-r5o 
[ 0 0 8 0 J i = i + 1 
(4) A*ryu=f y XASrfflV^fc^f6)#fiE5K 

(0 0 8 11 *!aiWo«f6i#A*«l^-Ctt. ¥fgi:foI^ 
10 <o|a-C*>5^<-:^t»ig4r. A* T/v-r^ y Xi.lc:43»t5^ 

15 [0 0 8 2] A*«i5g"CH. fc:^— y :5^7^-f 5/i5^Haf 
(n) Sr%x.So t^-y ;^x^5/^B8S:f (n) 

flg*^e>anE(oy— K--MS*t?co=i;^ h«r^;tSSIS* 
20 g (n) . ma£<5oy- Kd>f>S*^4*Si--SS^-c<o=i;^ 
hcDit^ffiSr^x6Ba^iS:h (n) ki-ht. b^-y 
;^T'-<y^Bife£ (n) tt&«;icio^x.fc*x5o 
[0 08 3] 
I (n) (9) 
25 M*ixTi/^/^v>&tWa<fy-KSrSBBi-So fi|l*>> S 
— Ko^ggcoy— K (successors) Sr^flgb. t 

;6^Srefe*L//i:mt-y ^ h "open" JC*Px.^o rcoft^ttlc: 
XoX< «-y— Ktt^7 7(D4'lc:-|HlA:JtSiv6;ii:*s 

(008 71 y ;^ h "open" tV^^h "close " Sr^SH^ 
i'StBflibBaSfc LT. "find-path, insert-and-sort-pa 
th, delete-path " tSfelS-t-So BB» "find-path " 
35 ^'?-:'^flSigt y :^ h (open Xliclose) Sr^lSt §1^ 

(parse) «j&«:«FO/>-:^(path)«igd«y h^PICfiF^i- 
[0088] Siik "insert-and-sort-path" It^^:^ (pat 

h)mmtv ^ h^^mti.. y h*c^<^*ifAb. «fj 

)tlH^^te;5^?>fi»4*^fli*t?03:^ holt^^ "path, total 

-cost " <0/J>$V^JIiaiCV— hi-^^o KS: "delete-path 
45 " ^<:^«iti y ^hi:9mt U 5lftOy^^«it 

4ry :^ h;5^^Hmt-^o 

[0 0 8 9] &isj$»iRic*5v^-c. y-K (^^•;^ 

''imroediate-left^arses " $r;£&i'6. BISc "imroedi 
50 ate-left-parses " tt. y^tSigi yyW( 
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igo^^ (:s:siffl) »ciig^L9 5-*--^roy<-:^fieigo 

(1) §iao>''?-;^«3S<DB8tfe{aa;6«ceo^<-:^t»JS<0 

(2) 3m<Oy<-7.mm:(D^'^i^B<OD:^ht^m^(0^ 

(3) :i(r>^<-:^mmt^h?m(0^<-:^m^i^^(Offii^^ 

^ h Sr8tSfi"'5ISSct bT "transition-and-word-cos 
t" Sr^S^So B3S "transit ion-and-word-cost" 

[0 0 9 0] «fe<Dy-K5&^e>«»«l»'^^5* 
•C^3>^ hSrit5;fc:i6IC, "cost-from-beginning- 
of-sentence " $r^^i"5o ffiSc "cost-froin-beginnin 
g-of-sentence " l±. S:®;&^b5l»0/<— ;^«lig»Cii5 

Rl;:ff Sf * nT*5 9 s "parse, prob-so-f ar - * 

[0 0 9 11 0911. ^lte<«OA*flg«aJ(0 

10 0 9 2] ;^5^yj/10l) S:*iCt5V^T. i&SSSS 
b4r "open" Jc:{^A"r5o wCT. SaSfc 

"backward-search-initial-paths - 11^ wOilp/j^^D 

MfkiffiBftt-rSo "closed" g&yx 

open I =backward-serch-i n i t i al-pa ths 0 ; 
closed:=nil ; 

:^Ty:ri0 2) "open" t^^D :^ ht^if 0 ti^^m-< 
<C»t4xtf. :^f^y:/10 3£il»<O«!.aSrfT5o 

[00 9 3] open==nil ? 
>^xy:^l 0 3) "open" <7>JfellSI*«:^Sc "bestpat 
h" left Ai- -So 

[0094] bestpath:=first(open) 

"C. B9% "is-beginning-of sentence' li. :L<0§kWi: 

"bestpath" 355aigfl?-c*> . gi^^5^5ibuyi:::^«rii 



I 0 5JWI*o«i3aiSrtf 9o 
[0 0 9 5] 

05 is-beginning-of-sentence(bestpath-parse) ? 

O 5) Sf» "open" "open" ;5>^e,Jfe 

IS®SSrffi«9 8*V^/hy ;^ hSrf^A-f 60 ftt-. BBS "in 
sert-and-sort-path" ^SrfflV^T. "bestpath** Sry^^h 
"closed" -^»Ab. "closed" <0^« ^|D)««l|gA*€> 

[0096] open :=rest (open) ; 
insert-and-sort-path (bestpath, closed) 
^^Ty^l 0 6) KSC "imraediate-left-parses " Srffl 
V^Ts "bestpath" (0^<-':^:^u h 

ccessorparses** iCf^A't'So K^^X^ successor-parse 

s" <DjfeSiS^*: "successorparse" JCftAU. 3*0*: 
"successorparses " left A"!" So 
20 [0 0 9 7] successorparses :=in»nidiate-l eft-parses 

(bestpath. parse, parse-table) : 

successorparse :=f irst (successorparses) ; 

successorparses: -rest (successorparses) ; 

x^T'5/:/l 0 7) "successorparses " (0-^^X(O^M 
25 S:*QfauyJ:;i*S:«!jSi-5o {>U ^^-Cfctbli, 

:/i 0 2|e»?tU -t 5T-/Jtlttttf;^7^ .y:7"l 0 8<r>«i 

[00 9 8] succesorparse==nil ? 
>^7^^:/l0 8) |frUV^x<;^tSitS:«0ST. ClixSrSaj 
30 » "newpath " left Ai" 60 BBS: "make-path " llSfb 

-tLT^ "newpath. parse " lell^ "successorparse" 
SrftAL. "newpath, previous" ICII "bestpath" Srft 
Ai"So "newpath. cost-so-far " leil^ "bestpath. p 
35 arse" ^T^^ ;^ h "bestpath. cost-so-far" 

"bestpath. parse" "newpath. parse " ^OjS 

^0=3;^ b<Ofp^5ftAS5nSo roffiS^a:^ Ml. fliISc 
"transition-and-word-cost" S:fflV>Tgt^ $ tbSo 
"newpath. total -cost" leii. :SC^t^h "newpath. pars 
40 e " * -CiO 3 ;^ Knewpath. cost-so-far) t . 3t8H**t> 
newpath. parse 4 ;^ h<^SldSftA*h.S. XsS** 
^0=3;^ hdR9@C "cost-from-beginning-of-sentence 

newpa th : =inak e-pa th 0 : 
45 newpath. parse: ^successorparse; 
newpath. previous :=bestpath; 
newpath. cost-so-far.*=bestpath. cosl-so-far 
i-transi tion-and-word-cost (bestpath. parse, newpath. p 
arse) ; 

50 newpath. total-cost-so- far 
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+cost-from-b€ginning-of-sentence(newpath. parse) : 
y^TyZ/l 0 9) "find-path " ^rfflV^T. succes 

sorparsse ft--'^— -5^>^ n y h t>0-''?;^tBJS;5S "open- 

[0099] find-path (successorparse, open) =nil ? 

1 0) "succdessorparse ** y 
HC}to "open" iO^fO^'^T.Wktc^^ "oldpath " 

[0 1 001 

oldpath:=find-path(successorparse, open) ; 
7^Ty~fl 1 1) "newpath. total-cost" k "oldpath. 
total-cost" Srtt:IS5l-5o t 1-. "newpath. total-cos 

t" <o:&;J5:^#<tntf. mi^'^r^z^Ty^i 1 8(c^ 

Vrir^o t>b. "newpath. total -cost" O^jftS/h^^JtiX 
[0101] 

newpath. total-cost <oldpath. total-cost ? 
;^T':y:7'l 1 2) "delete-path " SrfflV^T "ope 

n" /l^e> "oldpath " Srfi'lBfeU. 691% "insert-and-sort 
-path" ^r^flV^-r. "newpath ** S: "open" ^ifAUfe 

[01 02] delete-path(oldpath. open) : 
insert-and-sort-path (newpath, open) ; 
^7^5/^1 1 3) BSIckfind-path Sr^V^Xsuccassorpar 

se^y<y^:p^^y h»c}^o/<>^*?ig;5S "closed" l^^^tL 

[0 10 3] 

find-path (successorparse, closed) ==nil ? 
y^Ti^'fX 1 4) "successorparse" fir-'-?— o y h 
iZllto "closed" OilJiO/^J^^ftjgtrlESc "oldpath " l^l 

[0104] 

oldpath: -find-path (successorparse, closed) ; 
^y-iylfX 1 5) "newpath. total-cost" b "oldpath. 
total-cost" Sritesi"^* tL. "newpath. total -cos 

t" (0^t^:k^vii^^\^. i^\,'^ir\^:^Ty:rx i 8«c^ 

[0105] newpath. total-cost<oldpath, total-cost 
:^'r y:fl l 6) J^-ryT^l 1 StCifeV^TtL. "newp 
ath. total-cost" 0^^5/^gj^ntf> MSc "delete-pat 



h " SrfflV^T. "closed" t^h "oldpath " SrWgfe, 69 
@C "insert-and-sort-path" SrfflV^T "newpath " Sr 
"closed" '^IfAUfcftl-V—h-f^o -tLTJ^T^y^ 
1 1 8(C^fTi-^>p 
05 delete-path (oldpath. closed) ; 

insert-and-sort-path (newpath, open) 

yfsf'y':f\ 17) BISt "insert-and-sort-path" SrfflV> 

X "newpath " "open" '^Jf A UfcSl^iy- h-^^^p 

-tL"C;^7^5/:7'i 1 8ic^tf1-5o 

10 [0106] inset-and-sort-path (newpath, open) ; 

7^7- y 'fx 18) "successorparses " ^jtcPS^ir 
"successorparse" ^f^AL> "successorparses " O 
aO^OHlRSr "successorparses " '^f^A't'^o U 
y<Ty'f\^l\zM^^^. 
15 successorparse : =f irs t (successorparses) : 
successorparses t=rest (successorparses) ' 

3 (D^iR) # A* aisgffl 2 J; 0 1# e>lxfcJKfil^«f*r^ 
ia<Oflf9lC*3V^T. HI 0 0«-S:«-»L'X±ie3ffl<0}Bffi 

[0107] Hi Oicjiv^-c\ TsSUi* Ui&^fcv^<^> 

<Ofl|«P;55 S iSS^JS:* i: o fc t (Ot^^ -25. 82409083887518 

25 xfc9. ^(r>w.mmV\^m±. rssij r«cj r«L 

30 i:«^^UXV^-5o m2t^ffi^TJ«m3^1il^ov>-ctl^fil 
XfcSo 5ft^«l, g«S«gc$:i:oTV^2>(Z>xrA<^fili: 

[0 10 8] (5) *fg^x/uo*6;fe 
35 *i§^x/Ht3e6iS7;^^ iisgi?' 3-/^;^d>e>iS.8^ 

[0 1 0 9 J ;lc^WX«i. Sf^»J(DS:^*:Ho|att^*rffl 

40 «rC=c, c, — c, t-rs. t;&5^^feixfcB#<?5 
^fg<^a;^fl|iPSr0c«;Xifilfl*-fr5o rrx "#" H:» 

[0 110] 
[«C5] 
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P (w I t) -P. (C) - P. (ci I #. #) P. (c, I #, Ci ) 
JTlPi (C» I Ci-i , Ci-» ) Pi (#|c..i, c, ) 



(1)0) 

10 [0112] 
[^6] 



5. rrt?. N, (c,.,. c,., . c,) 11. 

Pi (Ci I Ci-1 , Ci-i ) =f « (Ci I Ci-a , Ci-1 > 

N I ( c i-i , c 1-1 , c I ) 



N, (ci-1 . c t-i ) 



(11) 



10 1131 — fixi::, rojc^^Hoiaite^Srli^e-t'Sro 20 



P (c, I 



C,.,) =q, f (c. ! C 



+ q , f ( c , I c ,., ) + q , f 

5. 

[0 114] (6) nmsxnn^^ 

[0115] *S{Rift^6P 9 1*. 5 fc«> 35 

It, 8^ll6l#»^Rl^:*s^^T. A;^i:Jt<o*>5S:*fii:ia*»e>*6 

fflfto^isffiiaft-^-rs. 40 

[ 0 1 1 6 J la 1 Hi, ^^fRtft^fiKeS5<oiKif'^SrItt9^r 
4fc»<D7o-^^- h-CfoS. «Tt?«l, i^iatwtso 

(0 1171 ^f§KSft;4.fiKS5 9 14. A;^S:^?'J "strin 
g" . Rt»«mi§iRlftSr^^i-'<#X^ffl:S i SrSISSt L 45 
TJ^^^ixS. "delimiters" ICtt, -SjjS 

( . ) , ) <St<O^K<0-g|Jt»«C9tt»5cv^B:9J 

Offi^Oy "open-categories " 



(c.) +q,V (12) 

10 1181 T.y-y^l 0 l) *IHRttt<Dy;^ h4rttifl>> 
rS^St "word-hypos" Icla^fiti: LT "nil " ft-^tA 

fO 1 191 word-hypos :=ni I; 

JWItt^ L-C0S:RA-*-5. 
I 0 1 2 0 1 j : = O 

T.'T-v-f'i. 0 3) *S(SKi(Og^5 i AS*|g«lttS:^±/Si- 
'<tX<rfSfcE i *»C>***-C(OS:#:>?iJ(Og^F J: < 

[0 1 2 ll j > length (string) -i 

J^7's/7'2 0 4) ^if{Riftt<C55:!?:5lJ<DSg^WX^?:*S 

tf. ^v's/:/2 0 9lc«tffi-s. K«ij|E^t?»i:»tix 

[0 12 2] menber (char (string, i+j-1), delimiters) 
T^'rv-fi 0 5) A^lftr^fll "string" Offie I A»e>*& 

j roei5»*!¥=?'J«rg?S5cformM^Ai-5. Clw 
t?. B98ksubstr«*. S»»?iJSriSi-BaiSt-t-5. 

(01 231 forra:=substr(strlng. i, j) ; 
;».^S'-:/2 0 6) r^i^^-r-:* y y x^. h "open-categ 
ories " OitWSm^'A'Bcpos ICftAL, «i3«:iKSS 

"poses " cn^A-rs. 

[0 12 4] poses: =^pen-categories: 
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pos : =f i rst (poses) ; 

poses :=rest (poses) : 

;^7^3/r2 0 7) ;i— ^^i'AT^r'y y h«0«*t>9»-it 

(0 12 51 pos==nil ? 

-C. ^leAS "form" T^o'iPAi "pos " T-fc5¥SOWS 
Jg^SrjJtJt., ^IS "prob" |C{tA-f--5. "wordprob 
-with-word-model" »±, ^Ifi t fig^*5l& t foS^S"! 

*»e>««^$*vS y ;»i Y^im. "word-hypo " fCf^tAU . 

::4xS:*8HKIfty h "word-hypos" (Oifenkin*. 

0 7 IdSPtf-rSo 
prpb:=wordprob-with-word-model (from, pos) \ 
word-hypo:=list(forni, pos, prob) \ 
push (word-hypo, word-hypos) ; 

;».v' y:?'2 O 9) ^BfRltty ^ h "word-hypo^" tift!^ 
lO 1 '2 b] sort-by-prob (word-hypos) ; 

[0 12 7] Pliaic*3V^-C. A;t^S:lCj|5*0S*sfc5a^ 
•T?tti|;*tt, ±IB«r)|g 9 ® J: 5 <f}K^t-*S. H i i w 

[0 12 8] ^S;»s^-r«^«fU:S@$i^TV^^S^(c& 
(®t{ffi^*s:*:tv^^i?lig^ft?tff^^6«^) Sr^feS^S 

t JKfii^AfW ost* t f S c: i: i: * 5*. ^ 
[0 12 9] <c*5, ±ia<753lffiffij-ri4> iKimss^^ 
/ufc ur (tri-Pos)^7'/i'4-tefflUfcA^ . 

«>6iJ»c|»;£*Jxa :uh.ft<. (tricUss) ; = . 

h^l*- ^'y(tri-tag) , • ^'^•A^ (tri-Ggram) 

(0 13 01 .Lfa^t604lC|6£$tt% 
[0131] 

[^WOjftmi ±3ffi<oi5lc, 3>:SBWIcJ:H»i, r&M^' 
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10 mmn^'^ftmm 
IS ^wE'efcs, 

' [la 61 fp8^8'J^|gm;/3fil*Sr*tE-C*>5, 

[0 7] 3lite0y«>N -best r^w^ y 

20 tOfefeOT*— ^'*8iS4r^i"®'C*)5, 

(@8l *«iq<D-|lifi0il<O«ftl6l#DP»sS*r^i-7a 

[139] *«iB«>-^ffl«<osiBitA*aa?sr*-r7D 

25 [Hi 01 ;4c%^(^-^;6&0y<o)^fi^/im4^4ftco09^^ 
. -[El i i 1 ;*:|Be«»-^ifii»«iii«HRBl«r^i-s»f^ 
[iai 21 *«w«o-iiifi0«<o*is(ssi©ws:^i-ia-T? 

30 *>«. 

(i?^«>iftM] 

".2 mi6)#A^«g5jl» 
3 Si,m9 *f¥t^—J<:^ 
. 35 ' 4 S^Mlt^T'/l'iftJfeaJ 

5 a^Hoffl«i^7'-:^/i' 

■ 7 ^ii^^/v-jt^efss 

40 9 ^l§<SI&^g|S 

i 6 .«iSatt:^=r7'— yyi' 

I o 0 aiwtt*7*/i' 

I I 0 ss3{'t*7'A'ffi;£^s 

1 2 0 aM=o«JSJp^-y/W 
45 1 3 0 aSs]giJ^Stt$;'3S6^9'-y-rt' 

140 

15 0 mi^tees^en 
170 aaSK^^ar^— 

180 S2^^'i^{'t#3— >'<X 
50 1 9 0 ^S^^/W 
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I START I 




qSJ{ 2 



- 16 - 



4#l§^7-2 7 1 7 9 2 



I S TAR T ] 



rS I 0 I 



open: »backv8rd- search- tnltlal -paUiSf): 
Closed: nnll; 




^ S I 0 2 • ^ ' 

J— S I 0 3 

^^^■» | cKU<«uccei«); | 



'tuccostorpar«a»:*liwedlBie-1eft-parses(beatpath, parse, parse- table); 
successo rperse : • r 1 rs t f succes sor bars ei I ; 

iucct»sor»arsB> ;"re» l(lucce»sorparses ) ! 



NO 



wcceasofpBrs<**n11 



YES 



IMP 



1 0 7 



1 0 8 



newpa th: "oake-pa th( ) ; 
nQ«path.p»rtq;»sueiatforpar9e; 
newba Ih. previous i »bes tpatb : ^ 
netrpath. cos t-so'f ar: «bestp4th.< 



newpath.§osk-so-far:«b8stp4th.co$t-so-far 

♦lran$1tlon-and-vord-coSl(bfi«lpath. parse. newpalh.parsa): 
newpath. total-cost :"nawpath.cpst-so*rar • 
♦COS t-f rOM-bo9lim<n9-bf-senUn<c{newpath. parse) ; 




I oldpjith:gf1nd"path(successorparsc,open); V ^S I I 0 

* ^ M I 

newpe th. Iota I "COS Uoldpath. total -cost^ 

7rts 



1 ftig{:gSgig?ggaftffSMth,open); M ' 



I 2 




I oldpathfflnd-patli<«ucce»sorpars8, closed); S I 1 4 

^-S I I 5 

st<o1dpath.TQr 




1 nsert-and-sor t-pa9b(neirpa tti, open ) : 

3: 



sueeesserparsex*! trst(sttccessorpBrses); 
»uccas»orparsas;»rest(toce«iorbar$fls) ; 



1 0 6 
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^mW- 7-271792 
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START 

i 



word— hypos: =ni I; 
I 



.S2 0 1 



— S2 0 2 



YES 




YES 



form: ■^atetKstring; i, j); 
I 



poses : =open— catogor i es ; 
pos: =first (poses): 
poses: —restCpose^); 



-^2 0 6 




S2 0 8 



prob: =wor<l3ort)— with— vwrd— modal (foim pos); 
word— hypo: =list(fonRPos.prob); 
push(v»ord — hypaword —hypos); 

1 



sort-b/-prob (word-hypos): H-S 2 0 9 



END 
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